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Abstract 


Adaptive  networking  (AN)  focuses  on  creating  a  logical  and  extendible  framework 
for  a  multiyear  effort  in  AN  research.  The  U.S.  Army  Research  Laboratory  (ARL) 
designed  an  experiment  to  identify  which  communications  protocol’s  parameters  were 
more  likely  to  have  a  relevant  effect  on  network  congestion.  The  software,  called 
experiment  control  software  (exp_driver),  was  developed  to  automatically  execute  the 
experimental  design  to  test  the  protocol’s  parameters.  Prior  to  the  exp_driver  existence, 
the  experimental  design  for  similar  tests  was  executed  with  frequent  operator 
intervention,  requiring  extra  time  for  set  up,  and  introducing  human  errors.  This  report 
provides  a  description  of  the  exp_driver  configuration  for  others  who  want  to  implement 
this  software. 
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1.  Introduction 


Adaptive  networking  (AN)  focuses  on  creating  a  logical  and  extendible  framework  for  a 
multiyear  effort  in  AN  research.  Advanced  concepts  to  distribute  information  on  the  battlefield 
are  considered.  The  automatic  adjustment  of  the  communications  (commo)  protocol’s 
parameters  or  factors,  such  as  message  length  and  arrival  rate,  based  on  heuristics  and  continuous 
monitoring  of  network  statistics,  is  one  approach  being  pursued  to  improve  real  network 
throughput  and  minimize  delay.  The  U.S.  Army  Research  Laboratory  (ARL)  designed  an 
experiment  to  identify  which  factors  were  more  likely  to  have  a  relevant  effect  on  network 
congestion  [1].  The  experimental  setup  consisted  of  various  computers,  referred  to  as  remote 
nodes,  connected  to  tactical  net  radios  via  modems,  each  running  a  scenario  driver,  and  the 
commo  protocol  to  be  tested.  Each  remote  node  collected  information  on  messages  sent  and 
received  to  analyze  at  a  later  time.  The  software  called  exp_driver  was  developed  to 
automatically  execute  the  experimental  design  to  test  the  protocol’s  factors  where  k  factors  were 

combined  and  tested  at  two  levels  (low  and  high),  implementing  a  2^  factorial  design  [2].  The 
combination  of  factors  and  levels,  or  factor  level  combinations,  form  the  design  matrix.  The 
design  matrix  was  executed  and  replicated  several  times.  The  messages  for  the  scenario  driver 
for  each  factor  level  combination  were  distributed  randomly  in  time  according  to  a  Poisson 
distribution. 

Prior  to  exp_driver  existence,  the  experimental  design  for  similar  tests  was  executed  with 
frequent  operator  intervention.  This  required  extra  time  for  setup  and  introduced  the  possibility 
of  human  errors  during  the  initialization  phase  and  data  reduction  phase  of  a  factor  level 
combination. 

The  objective  of  this  report  is  to  provide  a  description  of  the  experiment  control  software 
configuration  for  others  who  want  to  implement  this  software.  It  is  written  in  the  C  programming 
language  and  uses  X  Window/Motif  functions  under  the  UNIX  operating  system. 
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2.  Software  Configuration 

exp_driver  is  a  menu-driven  user  interface  written  in  C  programming  language  [3]  that  uses 
the  X  Window  library  [4]  and  the  Motif  toolkit  [5],  It  coordinates  all  tasks  necessary  to  execute 
the  experimental  design  from  a  computer,  herein  referred  to  as  the  control  node.  Software 
execution,  inputs,  and  factor  level  combinations  for  the  test  are  controlled  by  exp_driver. 

Among  its  tasks,  exp_driver  generates  messages  for  the  scenario  driver,  updates  the  factor 
level  combinations,  distributes  the  information  to  the  remote  nodes,  and  synchronizes  the  nodes’ 
clocks.  In  addition,  it  starts  and  ends  each  factor  level  combination,  retrieves  all  log  files  from 
the  remote  nodes  to  store  on  the  control  node,  and  computes  measures  of  performance.  To 
minimize  blocking  and  possible  input  errors,  exp_driver  runs  all  factor  level  combinations 
without  human  intervention.  The  software  is  capable  of  executing  independent  replications  of 
the  design  matrix  automatically,  with  each  replication  using  different  random  numbers,  starting 
in  the  same  initial  state,  and  all  statistical  counters  reset  to  zero. 

exp_driver  reads  text  files  to  obtain  initial  values  that  may  vary  depending  on  the 
experimental  design.  These  text  files  contain  values  that  need  initialization  prior  to  the  factor 
level  combination,  such  as  factors  and  levels  of  interest,  the  number  of  replicates  for  each  factor 
level  combination,  the  number  of  replicates  for  the  center  point,  the  random  number  seeds  to 
generate  the  desired  message  sets  or  scenarios,  the  number  of  tries  for  each  message  not 
delivered  during  the  retry  timeout,  the  node  identification  string,  and  the  length  of  each  factor 
level  combination.  Other  values  that  are  initialized  are  the  name  of  the  directories  into  which  the 
software  will  store  the  data,  the  directories  where  shell  procedure  files  that  need  execution  are 
located,  and  values  that  are  used  by  the  data  reduction  software.  The  text  files  used  for 
initialization  may  be  modified  either  by  editing  the  files  prior  to  running  exp_driver,  or  by  menu 
selection  before  executing  the  experimental  design. 

The  commo  and  scenario  driver  software  on  the  remote  nodes  have  their  own  input  files  and 
need  to  be  updated  prior  to  each  factor  level  combination.  The  control  node  has  a  copy  of  these 
files  (template  files),  which  exp_driver  updates  and  copies  on  the  remote  nodes.  Template  files 
are  used  whenever  part  of  a  file  needs  to  be  modified.  Template  files  are  similar  to  a  form  where 
the  user  fills  in  the  blanks.  The  blanks  are  filled  with  the  information  for  that  specific  factor 
level  combination,  and  the  file  is  copied  either  on  the  control  or  remote  node  where  it  will  be 
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used  during  the  test.  Examples  of  this  kind  of  file  are  the  commo  protocol  input  file  loaded  by 
the  commo  software  to  initialize  the  nodes’  id,  the  window  size  and  retry  timeout  (Figure  la), 
and  the  nodename##  file  from  which  the  scenario  driver  gets  the  message  information  to  load 
messages  into  commo  software. 

exp_driver  executes  some  of  its  tasks  by  invoking  UNIX  shell  procedures  [6].  On  the 
remote  node,  it  synchronizes  clocks  and  starts  and  ends  the  execution  of  a  factor  level 
combination  (Figure  lb).  On  the  control  node,  it  copies  and  retrieves  files  to  and  from  the 
remote  nodes  (Figure  la). 


b.  Update  of  a  shell  procedure  to  start  a  process  on  the  remote  node. 


Figure  1.  Template  File  With  Shell  Procedure  Interaction. 

While  executing  a  factor  level  combination,  each  node  collects  data  on  a  log  file  local  to  that 
node.  The  log  files  contain  information  on  the  messages  and  acknowledgments  (ACKs)  sent  and 
received,  as  well  as  information  on  queues.  The  data  reduction  software  is  a  set  of  C  language 
programs  that  reformat  log  files  and  compute  measures  of  performance.  Exp_driver  executes 
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UNIX  shell  procedures  to  invoke  the  data  reduction  software.  For  example,  for  each  log  file 
created  by  a  factor  level  combination,  exp_driver  executes  a  shell  procedure  process. s,  which 
invokes  the  C  program  dr  with  a  set  of  arguments  to  create  a  file  containing  the  messages 
transmitted  during  a  particular  factor  level  combination  grouped  into  1-min  time  intervals.  The 
shell  procedure  process. ack  invokes  dr  with  different  arguments  and  outputs  all  the  ACKs 
generated  during  that  factor  level  combination.  The  shell  procedures  that  contain  node 
information  are  updated  using  template  files.  The  output  of  the  data  reduction  software  is 
formatted  in  a  fashion  suitable  for  a  statistical  analysis. 

3.  Flow  of  Events 

When  the  experimenter  selects  automatic  mode,  exp_driver  executes  the  first  run  or  the  next 
replication  of  the  test.  Following  the  steps  on  Figure  2,  the  data  files  for  the  scenario  driver  are 
generated  first.  Then,  the  commo  protocol  input  files  are  updated  with  the  current  factor  level 
combination  information.  The  data  and  commo  protocol  input  files  are  then  copied  onto  the 
remote  nodes.  Clocks  are  synchronized  by  setting  the  time  of  the  day  on  the  remote  nodes  to  the 
same  time  on  the  control  node.  Once  the  initial  setup  is  completed,  the  test  is  ready  to  start.  The 
software  now  executes  a  shell  procedure  to  execute  the  commo  and  scenario  driver  software  on 
the  remote  nodes.  Once  the  scenario  driver  puts  all  messages  for  that  factor  level  combination  in 
the  queue  for  transmission,  exp_driver  waits  a  specified  amount  of  time  to  make  sure  the  queue 
empties  before  the  software  is  stopped.  Once  this  time  is  up,  all  software  on  the  remote  nodes  is 
stopped  by  running  another  shell  procedure,  the  log  files  are  copied  onto  the  respective  directory 
on  the  control  node,  and  the  data  reduction  software  is  applied  to  the  log  files  on  the  control 
node.  The  exp_driver  now  continues  with  the  next  factor  level  combination,  applying  the 
procedure  just  described  until  all  factor  level  combinations  are  completed.  It  continues  with  the 
center  point  factor  level  combinations  in  the  same  fashion  until  they  are  completed,  ending  the 
test. 

The  test  may  be  stopped  and/or  continued  through  menu  selection  if  any  problems  arise 
during  a  specific  run.  When  the  test  is  stopped  in  the  middle  of  a  run,  that  combination  may  be 
restarted  or  the  next  combination  started,  but  it  cannot  be  started  in  the  middle  of  the  run. 
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Start  automatic  execution. 

(a) - 


Generate  data  files  for  the  commo 
loading. 


Get  the  commo  input  files  from  the 
remote  nodes. 


Update  commo  input  files  with  new 
factor  level  combination  information. 


Distribute  data  files  and  commo 
input  files  to  the^mote  nodes. 

Synchronize  all  nodes. 

'I 

Start  the  commo  and  the  scenario 
driver  software  on  the  remote  nodes. 

For  each  remote  node,  look  for  the 
string  “scenario  driver  done  on.” 


Was  the  string  received? 

]/.  Yes 

\  Keep  running  for  a  specified  time  to 
/  assure  messages  in  queue  are 
transmitted. 


Stop  execution  of  commo  and 
scenario  driver  on  remote  nodes. 


Copy  log  data  files  from  the  nodes 
to  the  control  node. 


Create  reduced  data  files 
from  log  data  files. 


Increment  counters  and  initialize 
variables  for  the  next  factor  level 
combination. 


Did  all  factor  level  combinations 
complete  execution? 

V  |yes 

(  A  )  Increment  counters  and  initialize 
variables  for  the  center  point 
combination. 

nI' 

Did  all  center  point 
combinations 
complete? 

"V  Ves 

©  Test  completed. 


All  the  commands  executed  during  a  factor  level  combination  are  saved  for  later  reference.  A 
unique  directory  is  created  to  save  the  data  collected  for  each  factor  level  combination, 
simplifying  the  search  for  a  specific  file. 

For  ARL’s  experiment,  the  following  three  main  directories  were  used:  (1)  The  local 
directory  contained  the  exp_driver  executable  and  its  input  files.  (2)  The  DATA  directory 
contained  the  template  files.  Directories  for  the  output  data  files  were  created  under  the  DATA 
directory.  (3)  The  BIN  directory  contained  the  shell  procedures. 

Once  the  software  executed,  and  as  the  factor  level  combinations  were  completed,  unique 
directories  were  created  for  each  replicate  and  factor  level  combination.  Output  data  files  and  log 
files  were  copied  into  directories  in  which  names  reflected  the  replication  and  factor  level 
combination  for  that  run  (i.e.,  for  ARL’s  experiment,  for  replication  0,  factor  level  combination 
1,  the  information  was  automatically  stored  in  the  directory  ./DATA/REPO/ITERATION1). 

4.  Hardware  Configuration 

Different  hardware  configurations  may  be  used  to  run  an  experiment  with  exp_driver  as  long 
as  the  input  files  contain  the  right  information.  The  hardware  configuration  for  the  ARL 
experiment  is  explained  in  the  next  paragraph.  The  commo  protocol  and  scenario  driver  were 
developed  by  ARL’s  researchers  and  programmers. 

There  were  three  remote  nodes,  each  of  which  was  a  SPARCbook  3  [7].  Each  contained  a 
commo  protocol  and  a  scenario  driver.  The  commo  protocol  included  data  collection  functions 
to  log  the  sending  and  receipt  of  messages  and  acknowledgments,  as  well  as  information  on 
queues.  The  scenario  driver  provided  the  commo  loading.  The  remote  nodes  were  connected  via 
ethemet  to  a  SPARCstation  20  [8]  that  served  as  the  data  storage  and  control  node  (Figure  3). 
The  remote  nodes  were  connected  to  Single  Channel  Ground  and  Airborne  Radio  System 
(SINCGARS)  combat  net  radios  via  tactical  data  buffers  (TDBs)  [9],  a  modem  between  the 
radios  and  the  terminal  equipment.  Resistor  loads  were  used  as  the  antennas  to  reduce  the 
transmission  range.  The  TDB  interfaced  with  the  remote  node  using  RS-232C,  and  with  the 
SINCGARS  using  MIL-STD-188C(2)  [10], 
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5.  Conclusions 

The  template  files  are  useful  in  simplifying  the  programmer’s  job  when  the  experimental 
configuration  requires  modification.  This  allows  the  experimental  configuration  to  be  quickly 
and  easily  modified  since  the  input  is  not  “hard  wired”  in  the  code.  For  instance,  if  the  number 
of  nodes  needs  to  be  increased  or  decreased,  the  programmer  modifies  the  input  text  files 
containing  node  information,  and  the  updates  on  the  remote  software  take  place  during  the  test 
driver  initialization  phase. 

Because  the  test  driver  is  of  a  general  nature,  it  can  be  used  in  a  variety  of  situations  to  run  an 
experiment  in  a  distributed  UNIX  environment.  It  is  anticipated  that  future  experiments  can  be 
automated  to  consider  more  complex  communications  protocol  modifications.  Automating  the 
process  reduces  the  chance  of  operator  error  and  simplifies  the  execution  of  the  experimental 
design. 
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